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PRELIMINARY AMENDMENT 



PATENT APPLICATION 



Appln. No.: 09/816,306 

VERSION WITH MARKINGS TO SHOW CHANGES MADE 
Amend claim 1 as follows: 

1. (Once Amended) A method for multi-casting video content 
to plural user computers, the method comprising: 

distributing a video content program from a content center 
to plural regional data centers via an open network; 

distributing the video content program from each of the 
plural regional data centers to user computers [network 
connected] network- connected to the plural regional data centers 
according to a multi-cast protocol; and 

transmitting non-video data related to the video content 
program to the user computers for display by the [computer] user 
computers contemporaneously with the video content program. 
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& System and Method for Integration of High Quality Video 

;&e*3^ Multi-CastingService with an Interactive Communication and 
Information Environment Using Internet Protocols 




CROSS REFERENCE TO RELATED APPLICATIONS 



1 . This application claims priority under 35 U.S.C. § 1 19(e) from provisional application no. 
60/192,250, filed March 25, 2000. The 60/192,250 provisional application is incorporated by 
reference herein, in its entirety, for all purposes. 



particularly, the present invention is a system and method for broadcasting multiple video 
channels together with other non- video content over a network, preferably the Internet, without a 
material adverse impact on bandwidth capability of the network. 



3. Use of the Internet has been dramatically expanding, both domestically and 
internationally. Along with this dramatic expansion has come an increase in the requirements for 
the type of material being transmitted over the Internet. What was once the province of emails 
and document file transfers has now become one for interactive voice, telephony, and the desire 
for video transmission as well. 

4. While cable operators have long been transmitting video quality programming over cable 
network, there has been an increased interest on the part of the public to receive video quality to 
PCs over the various Internet connections and networks that exist. The difficulty is that Internet 
protocols result in low video quality being presented to the Internet user. This is also coupled 
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This invention relates generally to broadcasting of video over the Internet. More 
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with very high utilization of bandwidth and high infrastructure costs. In short, the Internet is not 
designed to accommodate high quality broadcast of video services due to the inherent 
characteristics and architecture of the Internet, which were not designed with video in mind. 

5. While the world wide web has become a very useful and flexible user tool for the 
dissemination of data, interactive operations and information services , a comparable ^ Fhis-user 
interface has not been integrated well with broadcast audio and video content such as that found 
on television and available over radio stations. On the other hand, television has developed into 
the most widely used audio, visual medium in the world, yet interactivity and flexibility is not 
generally available for television broadcasting. Further, a flexible user interface for the Internet 
has not been integrated in any significant fashion into television broadcasts. 

6. Currently, audio and video streaming sessions on the Internet are typically Auni " uni- 
cast"£ or intended for a single user, although many "single users" may want video at the same 
time. Thus, when a user desires to obtain a streaming video session of a particular video or video 
clip, the user contacts the server having the stored program and that video or video clip is then 
fed to the single user over the Internet. As many users attempt to access the same video, it must 
be again individually broadcast to each individual user. Thus the volume of uni-casting of videos 
poses the potential for utilizing large amounts of bandwidth that might be available to others. 
This has an adverse impact on both the quality and the speed at which a video streaming session 
can be downloaded to an individual user. Further, the quality of not only the video itself but the 
quality of the service of the ISP suffers as huge amounts of bandwidth are utilized by such video 
transmission. 

7. On-screen program guides and video-on-demand interfaces over television infrastructure 
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are well known. However, these types of broadcasts have been limited to the television 
infrastructure. They have not been designed with a true Internet protocol multi-cast service in 
mind. Thus, the existing architectures for use in video-on-demand via the television 
infrastructure do not extend to the Internet infrastructure because of technical difficulties with the 
Internet itself. 

8. What would be truly useful is to have an efficient and effective system and method for the 
distribution of video and television broadcasts over the Internet in a multi-cast mode. Such a 
distribution would be a high-quality video multi-casting service, meaning that a single program is 
simultaneously sent to many individuals. Such a service would also have an interactive 
communication and information environment associated with it, using the Internet protocol so 
that additional content can be viewed along with the video that is being received. 

SUMMARY OF THE INVENTION 

9. It is therefore an object of the present invention to allow for high-quality video multi- 
casting of video programs. 

10. It is yet another objective of the present invention to provide for interactive 
communication together with the multi-casting service. 

11. It is a further objective of the present invention to allow for information to be provided 
using Internet protocols for display along with the high-quality video that is multi-casted. 

12. It is yet another objective of the present invention to minimize the impact on the 
bandwidth of the Internet, yet still provide the multi-casting capability first noted above. 

13. It a further objective of the present invention to provide for both live and/or stored multi- 
casting of video streams. 
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14. It is a further objective of the present invention to minimize the cost for creating an 
Internet architecture for video broadcasting. 

15. It is yet another objective of the present invention to provide multi-casting on a broad 
band cable network. 

16. It is a further objective of the present invention to provide television quality video, CD 
quality audio, online communication including chat and instant messaging, together with Internet 
content, commerce, and services. 

1 7. It is yet another objective of the present invention to provide live and pre-recorded media 
presentations. It is a further objective of the present invention to provide for all of the above 
characteristics in a single interactive graphical user interface. 

18. The architecture of the present invention supports high quality video streaming, while at 
the same time reducing bandwidth consumption over existing techniques. The video content 
including synchronized information is delivered from a national content center (NCC) to 
Regional Data Centers (RDC) for cacheing of content locally. This reduces traffic on the 
backbone system of distribution, which in the preferred embodiment, comprises both the Internet 
and cable TV networks. In addition, video streams may be transported live from a broadcast site 
or a National Content Center to regional centers for subsequent redistribution. Video streams are 
multi-cast, using Internet Group Management Protocol (IGMP) and class D addressing with 
private multi-cast addresses. Router configurations and routing policies are controlled between 
the video server and the cable modem to allow true multi-cast to occur. This reduces traffic on 
the network by dramatically reducing the number of video content streams from that of a uni-cast 
system which otherwise would be providing an individual video stream to each individual user. 
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19. Several mechanisms support the transportation of the video content to Regional Data 
Centers from where it is multi-cast to subscribers. Any video information that is archived is sent 
to a cache memory at the servers at the Regional Data Centers. In addition, other media servers 
may exist across the backbone communication system. Since such archived video information is 
not in real time, it can be sent during off peak hours so that it does not disturb other traffic on the 
network, nor absorb a disproportionate amount of bandwidth, and thereby decrease the 
performance of the network. 

20. For those broadcasts which are to be done in real time, the content is sent in real time 
over the backbone of the network to regional distribution centers. The regional distribution 
centers subsequently distribute the video in a multi-cast mode to subscribers. Redundant servers 
and routers ensure that broadcasts are uninterrupted. 

21 . As noted earlier, the regional distribution centers can either store the video to be 
distributed, or take the single stream coming over the backbone and re-broadcast it in a multi-cast 
mode to its individual customers. 

22. When the system of the present invention is transmitting a live broadcast, a 
translator/multiplexer in the Regional Data Center receives the live broadcast content and 
converts it from the A "broadcasts-transport format to a multi-cast IP streaming format 
encoded, addressed, and associated with the necessary protocols for multi-cast in the 
local/regional network. Using this same architecture, archived content from cached servers 
having previously stored the live broadcast content, can also be multi-cast from the Regional 
Data Center to other servers or directly to individual subscribers. 

23. The video screen that displays the multi-cast video also displays data on the video screen 
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that is directly related to the video being shown. This additional content is displayed at the 
appropriate time and with direct relationship to the video program in question. 

24. The video screen which provides a graphical user interface for a particular user 
incorporate various A "buttons^j@-that can provide information associated with the objects in 
the video stream. In addition, to the extent that the multi cast is not a real time video feed, there 
will also be video control buttons such as stop, play, pause, or screen size manipulation. 

25. In addition this system of the present invention provides for imbedding of commercial 
advertisements and sponsor information into the video multi cast Internet protocol streams 
similar to those commercials that occur in a normal television broadcast. 

26. An aspect of the present invention that is not found in typical television is the potential 
for user interactivity and information content such as chat capability or messaging without multi- 
cast subscribers. Further a provision is made for opinion polls, and parental controls or other text 
based information associated with video programming. 

27. The information that is available on the user screen, especially that information which is 
interactive in nature, is synchronized with the associated choice of channel or video 
programming. Thus when a particular video is being shown, information that is relevant to that 
video or the subject matter of the video will also be displayed for the user. 

28. An interactive program guide allows a user to change channels using a single mouse 
click. This program guide can be scaled between a full program guide or a quick view summary. 

29. Thus the present invention provides for a high degree of integration of programming, 
program guide, information, and other communications then existing uni-cast services. Further 
the present invention provides for interactivity with a video broadcast in much the same way that 



Atty.Dkt.No.: 2585-009 



interactivity now exists on the Internet. Thus the system allows for the delivery of television like 
content over the Internet while controlling the parameters that affect video quality such as 
latency, jitter and packet loss. Finally, the present invention as configured reduces the number of 
individual streams necessary to access the video content. 

30. This information will be further understood by the detailed description of the invention 
that follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

31 . Figure 1 illustrates prior art for distribution of video over the Internet. 

32. Figure 2 illustrates the system architecture of the present invention. 

33. Figure 2 A illustrates the National Content Center architecture. 

34. Figure 2B illustrates a broadcast network of the present invention. 

35. Figure 2C illustrates the Regional Data Center. 

36. Figure 3 illustrates the graphical user interface of the present invention. 

37. Figure 4 illustrates the movie controls of the present invention. 

38. Figure 5 illustrates the viewer participation region of the PCTV interface. 

39. Figure 6 illustrates the promotional/sponsor area of the PCTV screen. 

40. Figure 7 illustrates the program guide portion of the PCTV screen. 

41 . Figure 8 illustrates the A "channel ticker"^ portion the PCTV screen. 

42. Figure 9 illustrates the multi-cast stream of the present invention. 

DETAILED DESCRIPTION 

43. Referring first to Figure 1 , the prior art for distribution of video over the Internet is 
illustrated. When an individual user 14 desires to view a particular video broadcast, a request is 



Atty. Dkt. No.: 2585-009 



made over link 30 over the Internet 12 to a particular host 10 which is connected to the Internet 
over link 22. The video requested is then streamed to user 14 over link 22 over the Internet 12, 
over link 30 to user 14. The difficulty occurs when users 16, 18, and 20 each desire to view the 
same or another video. Each user accesses the Internet over its respective link 24, 26, and 28 
over Internet 12 to host 10 over link 22. Host 10 must then download, most probably at different 
times, the video desired over link 22. Thus the traffic over link 22 is repeated at slightly different 
times even though the same video is being downloaded. This uni-cast mode takes a tremendous 
amount of bandwidth over link 22, thereby degrading the performance of the Internet service 
provider which is offering link 22 and the associated connection to the Internet. This problem is 
especially compounded when the video feed is in real time, wherein users 14, 16, 18, and 20 all 
desire the same video feed at the same time. This leads to a significant degradation in 
performance of link 22, and any associated equipment. 

44. Referring to Figure 2, the system architecture of the present invention is illustrated. A 
National Content Center 1000, which receives and distributes content over the total network, is 
connected to a broadcast network 1002. The broadcast network can be a cable modem network, 
satellite network, or any other type of wired or wireless network for the distribution of content on 
a national level. Regional Data Centers 1004 and 1006 are connected to the broadcast network 
1002. eaeh -Each Regional Data Center distributes content to its particular region. This may be a 
multi-state region, or some other region for which the data center has primary responsibility. 
Each Regional Data Center is in turn connected to a cable modem network 1010, 1008 where 
content is typically distributed in ways known in the art. These cable modem networks 1010, 
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1008 are the normal cable networks that are currently available for distribution of video to 
homes. Each cable modem network is in turn connected in the individual home to cable modems 
1012 and 1014. Individual client PCs 1016 and 1018 are connected to cable modems 1014 and 
1012 respectively to receive information from and interact over a network for various purposes. 

45. In this instance, however, video-like broadcasts are sent over this entire network so that 
individual clients 1016 and 1018 can receive video and digital video transmissions directly on 
their PCs. 

46. Referring to Figure 2A, the National Content Center 1000 architecture is further 
illustrated. The National Content Center comprises a series of servers for providing the content, 
advertising, and other information and features that are transmitted to the Regional Data Centers, 
and also comprises appropriate switches and routers for providing that information over the 
broadcast network. 

47. The National Content Center provides both live and previously stored content over a 
backbone network to Regional Data Centers. To provide this service, the National Content 
Center 1000 comprises streaming servers 126 and 128 which are redundant in nature. Any 
content that is to be "streamed" that is, provided continuously over the network, must be reliably 
broadcast. Hence, streaming servers 126 and 128 provide precisely the same content and hence, 
provide for redundancy in the event of the failure of any one of the servers 126, 128. The servers 
are synchronized in their broadcast by a synchronizer 124 which compares timing and other 
indicators in the broadcast from the two streaming servers 126 and 128, and ensures that they are 
precisely synchronized. Therefore in the event of a failure of either one of the servers, there will 
an uninterrupted broadcast to the ultimate customers. 

9 



Atty. Dkt No.: 2585-009 



48. The streaming content is then provided through switch 122 through router 120 and over 
the broadcast network (Figure 2, 102). 

49. The National Content Center 1000 also comprises a content manager 130 which is a 
server that manages other content that is transmitted along with any video that is transmitted. 
Content manager 130 comprises information that is related to the video that is being broadcast 
and allows users to link to other sites and other information that is of interest. 

50. The National Content Center 1000 also comprises an advertising server 132 that provides 
advertising that is to accompany the other broadcasts from the National Content Center 1000. 
Thus, national advertising can be submitted to go along with certain broadcasts while still 
allowing local advertising to be served by other Regional Data Centers (Figure 2, 104, 106). 
The National Content Center 1000 also comprises a publishing server 134 which provides yet 
additional content and other related information that has a direct relationship to the information 
that is being transmitted by steaming servers 126 and 128. 

51. In the case where a live event 138 is to be broadcast and carried by the system of the 
present invention, the live event 138 is broadcast in a traditional fashion and is encoded by 
encoding server 136 with the National Content Center 1000. This continuously fed encoded 
signal is then provided to switch 122 and then is transmitted over a router 120. All additional 
content, advertising, and publishing which might be presented by content manager 130, 
advertising server 132, and publishing server 134 can continue to accompany the live event as it 
is broadcast. 

52. The system of the present invention also can allow live Internet events 142 to be 
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broadcast via router 120. This information can be live chat rooms, live presentations and 
interactions of all different kinds. Further, previously recorded and stored content 140 can be 
transmitted as well via the router 120 from the National Content Center 1000. 

53. Referring now to Figure 2B, a broadcast network of the present invention is illustrated. 
National Content Center 1000 can optimally transmit in two fashions. First, its content can be 
transmitted to an uplink transmitter 144 for subsequent transmission by satellite dish 146 to a 
distribution satellite 148. Thereafter the transmission can be received by Regional Data Centers 
via a Regional Data Center satellite dish 150 and associated receiver 152. The transmission can 
then proceed to the Regional Data Center 166. Similarly other Regional Data Centers 164 will 
have their own associated receivers 168 and satellite dishes 170 for receipt of transmissions from 
satellite 148. All such transmissions will be accompanied by information from the publishing 
server, advertising server, content manager, and other information as appropriate from the 
National Content Center. 

54. The NCC 1000 also has the option of transmitting over the privately managed backbone 
154. This backbone may be an Intranet, a cable network, or indeed any other network that can be 
privately managed and administered by an entity running the NCC 1000. Redundant backbone 
routers 156 and 158 provide appropriate routing to various regional data centers. The backbone 
routers are linked and are redundant such that in the event of the failure of one router, the second 
router can continue to broadcast the content from NCC 1000. It should also be noted that, while 
two backbone routers 156 and 158 are illustrated, this is not meant as a limitation. Any number 
of backbone routers can be used to simultaneously transmit the content from NCC 1000 over the 
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privately managed backbone 154. Thus, the illustration of backbone routers 156 and 158 are for 
illustrative purposes only, and are not meant as a limitation. 

55. Content that is broadcast from the NCC is received by each Regional Data Center 164, 
166 via associated regional routers 160, 162. Thereafter, any content is subsequently re- 
broadcast by the Regional Data Centers 164, 166 to their respective clients. Again the two 
regional data centers 164, 166 illustrated in this figure are for illustrative purposes only and are 
not meant as a limitation. Many Regional Data Centers may exist and will be able to broadcast 
the content that is broadcast from the NCC to their respective clients. 

56. Referring now to Figure 2C, the Regional Data Center 166 is illustrated. For purposes of 
this figure, only one Regional Data Center is discussed, although each Regional Data Center will 
have similar architectures. Regional Data 166 receives its transmission via the backbone 154 
through its regional router 162 to the Regional Data switch 172. Alternatively, the Regional Data 
166 can receive its transmission via its satellite dish 150 through its receiver 152 and then to 
Regional Data Center switch 172. 

57. The structure of the Regional Data Center is similar in certain respects to that of the 
National Content Center. For example, streaming eas hcache servers 176, 178 are redundant 
cashcache servers which stream information and content to clients 186. A synchronizer 174 
keeps the streaming eashcache servers 176, 178 in synchronization. Therefore, if any one 
streaming eas hcache server fails, the second server will continue to provide the streaming 
product to clients via the synchronizer 174. Publishing server 180 works in concert with content 
manager 186 to provide additional content and information on the screens of the clients 186 as 
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the streaming content is provided to the PCs of clients. In this fashion, and as more fully 
described below, additional content can be viewed by clients. Publishing server 180, content 
manager 186, and any other servers 182 all provide their content via switch 172 to be 
accompanied by the streaming content from streaming eashcache servers 176, 178. 

58. Each Regional Data Center also has a local advertising server 184 to provide local 
advertising content that is sold by the Regional Data Center, and which accompanies the content 
and other streaming transmissions from the Regional Data Center. 

59. Referring to Figure 3, the graphical user interface of the present invention is illustrated. 
Figure 3 illustrates certain characteristics associated with the video screen itself. In this 
illustration, a portion of the display is devoted to a video screen 50 that comprises the movie 
content desired by a user. Image quality is up to VHS quality in a large format. Further, the 
video is multi-cast to multiple users at the same time. The image further comprises clickable hot 
spots within the video screen portion where a user can click and obtain additional information or 
displays. Further, data can be inserted into the video screen and be displayed at precise times in 
other areas of the PCTV screen. 

60. Referring to Figure 4, the movie controls of the present invention are illustrated. Movie 
controls 52 allow for the movie to be played, to pause, to stop, and to adjust volume, balance, 
and movie screen size. Further, controls allow for rewind, fast forward, storing of images, 
volume control. AH of these control instructions are exercised by the user via a mouse click 
which sends the appropriate signal to the Regional Data Center for adjustment of the stream for 
that particular individual. 

61 . Referring to Figure 5, the viewer participation region of the PCTV interface is illustrated. 

13 
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In this instance, the user is given a portion of the screen comprising tabbed areas, each of which 
could be clicked on by a user to gain access to different yet relevant activities. For example, by 
clicking on the "chat" tab, the user can be taken to a site that provides general audience chat, 
private^ "buddy list"£ chat, instant messages, or a full screen chat mode. The chat room that is 
accessed is keyed to the video presentation in progress. 

62. By clicking on the-A "games"£ tab 58, the user is taken to a screen where games that are 
relevant to the video being displayed can be played. Finally, a parental controls tab 60 can also 
be clicked to allow parental controls such as those known in the art to be imposed on any such 
viewing. 

63. Referring to Figure 6, the promotional/sponsor area of the PCTV screen is illustrated. In 
this area, certain clickable areas exist, which comprise buttons and logos that relate to goods and 
services for sponsors. Thus, for example, if a cartoon is playing and that cartoon is related to 
Nickelodeon7 a button will also exist to click on which will take the user to Nickelodeon7 
related products. 

64. The buttons and clickable areas for the promotional/sponsor area are program segment 
specific. These vary from program to program and are triggered by the video stream header. 
They comprise games, links, and services, all of which are directly related to the video stream 
being viewed. In addition, advertisements will also be keyed to the video that is being viewed. 
Thus if a particular cartoon character, for example, is on screen, a product can also be offered 
that features that particular cartoon character, thereby further encouraging the purchase. In 
addition, games button 64, puzzles button 66, surprise button 68, and additional button 70, all of 
which are presented for illustrative purposes only and are not meant as a limitation, will all 
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present subject matter that is relevant to the particular video being displayed. 

65. Referring to Figure 7, the program guide portion of the PCTV screen is illustrated. The 
program guide provides for a quick view of the daily schedule on the various channels that are 
offered over the PCTV. Clicking on any particular segment of the program guide brings up that 
particular portion of the video that is available at that time and on that date. In addition, email 
reminders can be scheduled so that a particular program is not missed. 

66. Referring to Figure 8, the A "channel tickers-portion the PCTV screen is illustrated. 
This portion allows a continuous stream of information to be presented to viewers regarding 
related news, information, promotional items, audience messages, helpful information, and 
related tips. Again this information is directly related to the video that is being shown, although 
this is not meant as a limitation. 

67. Thus, PCTV of the present invention provides high-quality video and audio programming 
over Internet and cable to a personal computer. It further provides communication capability by 
permitting live question and answer, audience chat, buddy list chat and instant messaging during 
the course of presentation of video and audio programming. As such, the present invention 
offers interactivity which is not now offered with current television programming. These above 
capabilities are integrated with electronic commerce activity such as sales of merchandise and 
services. Further, the system of the present invention allows for advertising, sponsorships, and 
web content, all of which is keyed to the video and audio being displayed. 

68. The file of this patent contains at least one drawing executed in color. Copies of this 
patent with color drawing(s) will be provide by the Patent and Trademark Office upon request 
and payment of the necessary fee. 
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69. Referring to Figure 9, the multi-cast stream of the present invention is illustrated. Using 
the present invention, video segments are encoded and indexed. Time code markers are inserted 
for the display of web content, to buffer an ad to be displayed, to play an ad, and to buffer the 
next segment. Referring to the timing strip 80, a typical series of events is illustrated. Initially, 
an introductory screen 82 is played on the users video screen. This is followed by a sponsorship 
message 84. The pre-recorded program 86 is then played for a period of time. The key aspect of 
the present invention however, is the fact that additional web content and other inserts may be 
presented on the PCTV screen at the same time that the recorded program 86 is being played. 
Thus for example, at time slot 88, a particular web content is displayed which is keyed to the 
recorded program. At time slot 90, an advertisement is placed in a buffer for subsequent display. 
At time slot 92, the advertisement that has been buffered is played. At time slot 94, additional 
web content in another part of the PCTV screen is displayed. At time slot 96, another 
advertisement is buffered. At time slot 98, the buffered advertisement is played. At time slot 
100, additional material is played in another part of the screen. 

70. Subsequently during other programming, an introduction 112 is played followed by a 
sponsorship message 114, and then followed by a live program 110. During the live 
programming, advertisements can again be buffered and played in other parts of the screen. The 
content of these additional ads and information are all directly relevant to the video being shown. 

71 . A system and method for integration of high-quality video and multi-casting servers with 
an interactive communication and information environment using Internet protocols has now 
been illustrated. It will be appreciated by those skilled in the art that other embodiments of the 
present invention are possible without departing from the scope of the invention as disclosed. 
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